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MULTIPROCESSING SYSTEM WITH INTERPROCESSOR COMMUNICATIONS FACILITY 

This mvention relates to the data processing field. More particularly, this invention is a multiprocessing 
computer system having an efficient mterprocessor communications facility processing 

w,,h' n a nnZ l T° CeSS ' ri9 T yStem ' S ° me mechan,sm uSual, V e *' sts *> allow one processor ,o communicate 

■ 1! r T /P ' C V ' Wh6n ° ne Pr0C3SSOr WantS t0 S6nd 3 messaae 10 anot ^ Pressor ° 
» places messages and aaaress pointers for intercessor communications in main storage. Mam storage 
must be accessed by both sending and rece.v.ng processors to perform this message transfer This 
burdens the nna.n storage and ,ts assorted c:rcu,try. delaying other accesses to ma.n sto ge and 
reducing overall system performance. y u 

o commu^Z nn° b T me ,raditi0nat aPPr ° aCh ° f interD '° cess °' communications i S the difficulty of 

o communicating w.m a spec.al type of processor, such as a service processor, when all messages must go 
ihrough ma,n storage. The service processor performs a variety of diagnostic, maintenance "and erS 
Th e r V .r f , 0Pera,,0nS ' USUa " y C3nn0t Wnte ! ° ma ' n S,0fage WithOUt ^ iesc ' nQ ^tire system 

system down, thereby l,m,t,n g the ability of the serv.ce processor to perform error recovery operations 
' and nZ antotn ™n*ocBS*«g communications have been comple, inefficient, structured 

cTock tu^J m Tn; qU "? PrOCeSSOfS 10 have ,dent ' cal c V cle «™« and operate off of synchronic 

z:::;— have not su,ficiem,y addressed ^ ^ °< — * «- 

• sor cV^mu^nstoSy 0 ' ^ " Pr ° V ' de ' ^ ^ « interpret.- 

lt is another obiect of the invention to prov,de a multiprocessing system with an intemroca^nr 
communications facility that does not requ.re the use of main storage interprocessor 

CQ m'm. l n> a ? 0mG » °' ' nVenti ° n t0 3 mu,ti P fOCe 5Sing system with an interprocessor 

communications facility that is flexible enough to be used by a diverse group of processors 

,-omm T d T 6 !- ° b|eCtS accom P lished °V ,he multiprocessing system with an interprocessor 
communications facility disclosed herein. ie. M iu<_w:>5»or 

s.na^««Lm^f 0 !h- WMm ar ° connected to the "^processor communications faclity in the multiproces- 
c rcu, Z an/L 0c ^r T ,n,erpr ° CeSSOf communications facility has arbitration circuitry, mailbox 
«nia7«^ r P ' nterproc8SSOr communications facility of the invention ,s 

ZTnT , reqU ' re US9 °' ma ' n St ° ra9e - ThiS Sflables Pressors to communicate with 

n ' n °' her 3 faSt and sff,cient manner - The ^ration circuitry prevents simultaneous access of the 
nterprocessor communications faclity by more than one processor, and decodes the commands sent from 

he cornmlnd Th ^ " ^ "^"^ °' « the ma " bo * «™* ^ Spending on 

the command. The ma.lbox c.rcuitry of the invention receives messages from sending processors and 
provides them to the intended receiving processors in a safe and secure manner. The (!oLs.o^t.r£pt 
arcu.try facilitates the interprocessor communications process by handling interprocessor in^rrupts 
comLnt T 3 " 60 * C ' rC f ^ COmainS 3 mai,b ° X 8rray h3Ving 3 P,urality of mailbox entries - mailbox entry 

Z a 2«2 e r ge ^ d 3 ' 0Ck fie ' d - EaCh ,0Ck ,i6ld C ° ma,nS 3 '° Ck bit 3nd a ,ock ID - <** Processor 
has a portion of mailbox entries reserved for its use. 

fac.liIvofr«fnl S l r ^ 0, ^ e m K U,tipr0cessina s *** m communicate with the interprocessor communications 
facility of the invention through one or more commands. 

The interprocessor communications facility of the invention can be accessed directly by a service 

n w S0 V 0 S6rViCe processor can communicate with the other processors of the system without 
quiescing the entire system. 



Brief Description of the Ora* 



mg 



Fig. 1 shows a block diagram of the multiprocessing system of the subject invention. 
Fig. 2 shows a block diagram of the interprocessor communications facility of the subject invention 
i-.g. 3 shows the aro.ter circuitry of the interprocessor communications facility of the subject invention 
m more detail. 

Fig. 4 shows a mailbox entry of the subject invention in more detail. 
F.g. i shows a Dlock diagram of the multiprocessing system of the subject invention. Processor 10 is 
connected to interprocessor communications facility SO 'via communications bus 4, and to main storage 40 
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via Dus 46. Processor 20 is connected to interprocessor communications facility 50 via communications bus 
42 and to main storage 40 via bus 47. Service Processor 30 is connected to interprocessor communications 
facniry 50 via communications bus 43. 

In the preferred embodiment, processor 10 is an Input/Output Processing Unit (lOPU), and processor 20 

5 is an instruction Processing Unit <IPU). although these processors could have other functions ano still fall 
witmn the scope of the invention. Service Processor 30 performs various diagnostic, maintenance, and error 
recovery procedures and can initiate Initial Program Load, alter and display General Purpose Registers, 
alter and display the Program Status Word, alter and display main storage, among other things. Although 
lines 41-47 are all shown as direct connection busses, any other type of communication path couid also be 

io used. 

interrupts between processors 10 and 20 are handled by processor interrupt circuitry 80 of interproces- 
sor communications facility 50 through processor interrupt registers 11 and 21. and will be discussed in 
more detail later. Oue to the special nature of service processor 30. interrupts between service processor 30 
ana any other processor of the system are typically not handled by processor interrupt circuitry 80 of 
is interprocessor communications facility 50. Instead, interrupts between service processor 30 and any other 
processor of the system are usually handled by service processor interrupt registers 12 and 22 and 
maintenance interface 32. In the preferred embodiment service processor interrupt registers 12 and 22 are 
capable of storing four different interrupt conditions, as shown below in Table 1 . 



PROCESSOR TO SER VICE PROCESSOR INTERRUPT CONDITIONS 



25 PROCESSOR TO SERVICE PROCESSOR INTERRUPT REQUEST 

SERVICE PROCESSOR TO PROCESSOR INTERRUPT RESPONSE 

SERVICE PROCESSOR TO PROCESSOR INTERRUPT REQUEST 

30 PROCESSOR TO SERVICE PROCESSOR INTERRUPT RESPONSE 



TABLE 1 

35 

Service processor 30 interrupts processor 10 via the SERVICE PROCESSOR TO PROCESSOR 
INTERRUPT REQUEST sent from maintenance interface 32 to service processor interrupt registers 12 via 
bus 44 and system maintenance hardware interface 33. In the preferred embodiment, system maintenance 
naraware interface 33 allows service processor 30 to be connected directly to the rest of the muitiproces- 
^ sing system. Service processor 30 then waits for a PROCESSOR TO SERVICE PROCESSOR INTERRUPT 
RESPONSE from service processor interrupt registers 12 to maintenance interface 32 via bus 44. Service 
processor 30 interrupts processor 20 in a similar manner, but via bus 45 and using service processor 
interrupt registers 22. 

Processor 10 interrupts service processor 30 via the PROCESSOR TO SERVICE PROCESSOR 
4S INTERRUPT REQUEST sent from service processor interrupt registers 12 to maintenance interface 32 via 
bus 44. Processor 10 then waits for a SERVICE PROCESSOR TO PROCESSOR INTERRUPT RESPONSE 
from maintenance interface 32 to service processor interrupt registers 12 via bus 44. Processor 20 
interrupts service processor 30 in a similar manner, but via bus 45 and using service processor interrupt 
registers 22. 

so In the preferred embodiment, interrupts from service processor 30 to any other processor of the system 
can aiso be performed by processor interrupt circuitry 80 of interprocessor communications facility 50 in 
special cases, such as when service processor 30 wants to send an interrupt to all system processors via a 
single command. The capability to interrupt all processors is a unique capability of processor interrupt 
circuitry 80 and will be described in more detail later. 

ss Referring again to Fig. 1, interprocessor communications facility 50 contains arbitration circuitry 60. 
processor interrupt circuitry 80 and mailbox circuitry 100. Communications busses 41-43 provide the inputs 
to arbitration circuitry 60. Arbitration circuitry 60 is connected to processor interrupt circuitry 80 and mailbox 
circuitry 100. 



3 
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Fig. 2 snows a block diagram of interprocessor communications facility 50 of the invention m more 
detail. Arb.tratton circu.try 60 prevents simultaneous access of interprocessor communications facility 50 by 
more than one processor. Arbitration circui try 60 also decodes the commands sent from the processors and 
routes them either to processor interrupt circu.try 80 or to mailbox circu.try 100. depending on the 
i command. Arbitration circuitry 60 is made up of holding registers 61-63. arbiter 64 multiplexor 65 and 
command decoder 66. 

( When processor 10 wants to communicate with processor 20 in the multiprocessing system it sends 
information to hqlding_ C egis.tei 61 via communications bus 41. The information contains a command an 
address, and optionally data, such as a message, lock data or .memjpidata. When holding~7e^.ster 61 

3 contains information, a reques t^ signal i s_ passed to arbiter 64 over request tine 71. and the information is 
presented to the inpg^QLrnu Iti plexo r 65 on data line 74. Arbiter 64 sends a control s.gnal to multiplexor 65 
on control hne 77. instructing multiplexor 65 to take the information on data line 74 and prov.de it to 
command decoder 66. Command decoder 66 decodes the command and senos .t either to processor 
interrupt circu.try 80 or to mailbox circuitry 100. 

i In the preferred embodiment, each command is composed of 5 bits, thereby permitting 2"5 = 32 

commands. The command decoder decodes each command by creating a separate m.nterm expression for 
each 5 bit command. A m.nterm expression is a minimum set of bits that when ANOed together form one of 
all possibly logically true terms. This decoding operation can be performed by a simple logic circuit 
arranged using well known digital logic design techniques. The actual design of this circuit is dependent on 

> the coding of the commands chosen by the designer. The logic circuit has one command decode line for 
each valid command. One command decode line becomes active when the command associated with that 
line is received by the circuit. 

Of the possible 32 commands. 10 are valid or recognized by the decoder, while the rema.nder are 
reserved for future use. Any invalid command raises an error signal. The decoder sends out the minterm 
expressions (s.gnais) to be used by the appropriate facility. A processor interrupt command is sent to 
processor interrupt circuitry 80. All other commands are sent to mailbox c.rcuitry 100. These commands will 
be discussed in more detail later. 

Fig. 3 shows arbiter 64 of the preferred embodiment in more detail. If there is a signal present on 
request l.ne 71 from holding register 61. command line 77 is activated, thereby instructing multiplexor 65 to 
take the information on data line 74 and provide it to command decoder 66. This is done even if there were 
simultaneously transmitted signals on request lines 72 and/or 73. Therefore, processor 10 .s always given 
priority in arbiter 64 over processors 20 and 30. 

If there is a s.gnal present on request line 72 from holding register 62, but no signal on request line 71 
command line 78 is activated, thereby instructing multiplexor 65 to take the information on data line 75 and 
provide it to command decoder 66. This is done even if there was a simultaneously transmitted s.gnal on 
request line 73. Therefore, processor 20 is always given priority in arbiter 64 over processor 30 but not 
processor 10. 

If there is a signal present on request line 73 from holding register 63. but no signal on request lines 71 
or 72. command line 79 is activated, thereby instructing multiplexor 65 to take the information on data line 
76 and provide it to command decoder 66. This is done only if there were no simultaneously transmitted 
signals on request lines 71 or 72. 

If it is des.red in a particular application to change the priority given to the processors, arbiter 64 can be 
easily modified by switching lines 71-73 and 77-79 around. Arbiter 64 could also be modified to handle 
more complex priority schemes. 

Referring again to Fig. 2. mailbox circuitry 100 receives messages from sending processors and 
provides them to the intended receiving processors in a safe and secure manner. Mailbox circuitry 100 is 
made up of mailbox array 105. message output register 160 and lock output register 161. Mailbox array 105 
contains ma.lbox portions 110, 120 and 130. Mailbox portions 110. 120 and 130 are reserved for the use of 
processors 10. 20, and 30. respectively, as will be explained in more detail later. Each mailbox portion 
contains one or more mailbox entries. Each mailbox entry contains message field 140 and lock field 150. 
f A mailbo * ©"try is shown in more detail in Fig. 4. Message field 140 consists of 8 bytes of data in the 
preferred embodiment, although this field could be smaller or larger and still fall within the scope of the 
invention. Usually, these 8 bytes of data would be a message from one processor to another. However, m 
some instances, such as with asynchronous communications between processors using task control blocks, 
as will be explained in more detail later, message field 140 is broken up into message field segment 141 
and message field segment 142. In this case, segment 141 contains the beginning address of a task control 
block located in main storage 40. Segment 142 contains the ending address of the task control block. 

Lock field 150 contains lock bit 151 and lock ID 152. In the preferred embodiment, lock bit 151 is zero if 
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■ the associated mailbox entry is not in use by a orocessor. if the mailbox entry is in use. lock bit 151 is one, 
. and lock ID field 152 contains identification indicia of the orocessor using the mailbox e ntry. 

Referring again to Fig. 2. Processor interrupt circuitry 80 facilitates the interprocessor communications 
process by handling interprocessor interrupts. Processor interrupt circuitry 80 is made up of holding 
s reg.sters 81-83. arbiter 84, multiplexor 85. and output registers 37-88. Arbiter 84 is substantially the same 
as arbiter 64, shown in more detail in Fig. 3, as has been discussed. 

When command decoder 66 decodes a processor interrupt command, it sends the command on to 
processor interrupt circuitry 80. Note that processor interrupt circuitry 80 is substantially similar to 
arbitration circuitry 60. This is done to provide an additional hoiomg area for processor interrupt commancs. 
to since processor interrupt commands can take longer to execute than the other commands which are sent to 
mailbox circuitry 100. 

In the preferred embodiment, command decoder 66 uses four clock cycles, TO. T1. T2, and T3. to 
decode and execute a command. During TO. the command is decoded by command decoder 66 and one of 
the command decode lines becomes active. From here on. the exact sequence of control signals depends 
on the command being executed. For example, when a REAO MESSAGE command is decoded, the 
address of the mailbox entry is gated to mailbox array 105. The array will access the addressed location 
and the message will be sent to output register 160. from which it is returned to the requesting processor. 
These steps'are performed during clock cycles T1-T3. 



command decode lines are used to gate the T-clocks through the control logic to determine which 



20 operations aVe performed and when. For example, when the PROCESSOR INTERRUPT command is 
decoded, it will gate the T2 signal to the proper holding register (81, 82. or 83) to latch the address and 
data. Some operations are performed by more than one command, so several command decode lines may 
be ORed together to gate a T-clock. For example, several commands cause the lock field of a mailbox 
entry to be read. Those commands are joined together to read the lock field and latch the output data into 

25 output register (161). 

The commands available for use by the processors of the multiprocessing system to facilitate 
interprocessor communications are shown below in Table 2. 



WRITE MESSAGE 

READ MESSAGE 

READ LOCK 

WRITE LOCK 

TEST AND SET LOCK 



RESET LOCK 



45 



TEST AND SET LOCK AND READ MESSAGE 

RESET LOCK AND WRITE MESSAGE 

TEST AND SET LOCK AND WRITE MESSAGE 



PROCESSOR INTERRUPT CIRCUITRY COMMAND 



50 



PROCESSOR INTERRUPT 



55 



TABLE 2 
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MAILBOX CIRCUITRY COMMANOS 



Message Commands 

The WRITE MESSAGE command is used by a processor who wants to send a message to another 
processor m the system. This command contains the message intended for another processor. In the 
preferred embodiment, this message can be up to eight bytes long, but this length could be different and 
still fall within the scope of the invention. The WRITE MESSAGE command also contains an address of a 
mailbox entry in mailbox array 105. This mailbox entry is within the message array -portion reserved for the 
processor for which the message is intended. When this command is received by command decoder 66. 
the message is placed in message field 140 of the addressed mailbox entry. 

The READ MESSAGE command is used by a processor who wants to read a message placed in one of 
its mailbox entries by another processor. This command contains the address of the mailbox entry that has 
the message the processor wants to read. When this command is received by command decoder 66, the 
message is retrieved from the addressed mailbox entry and placed in message output register 160. where it 
is sent on return line 49 to the processor who issued the command. 



2Q Lock Commands 

The READ LOCK command is used by a processor who wants to read the data contained in the lock 
field of a mailbox entry. This command contains the address of the mailbox entry corresponding to the lock 
field the processor wants to read. When this command is received by command decoder 66, the data 
25 contained in lock field 1 50 of the addressed mailbox entry is retrieved from the addressed mailbox entry 
and placed in lock output register 161, where it is sent on return line 49 to the processor who issued the 
command. 

The WRITE LOCK command is used by a processor who wants to write data to the lock field of a 
mailbox entry. This command contains the data the processor wants to write, along with the address of the 
30 mailbox entry corresponding to the lock field the processor wants to write. When this command is received 
by command decoder 66, the data is placed in the addressed mailbox entry in lock field 150. 

If there is data in the array with bad parity, such as during power up. this command can be used to 
initialize the array. 

The TEST AND SET LOCK command is used by a processor who wants to check a lock field of a 

35 mailbox entry to see if the mailbox entry is in use. and. if not. write data to the lock field. This command 
contains the data the processor wants to write, along with the address of the mailbox entry corresponding to 
the lock field the processor wants to write. When this command is received by command decoder 66. the 
most significant bit of the addressed lock field is checked. If the most significant bit of the lock field is zero, 
indicating that the mailbox entry is not in use. then the data from the processor is written into the lock field 

40 of the specified mailbox entry. This data in the preferred embodiment would be identification indicia of the 
processor making the request. By inserting this data in the lock field (and setting the most significant bit to 
one), the processor indicates that it is using this mailbox entry. If the most significant bit of the lock field is 
one. the write does not take place. In both cases, the data contained in the lock field before the command 
was received is placed tn lock output register 161. where it is sent on return line 49 to the processor who 

<*s issued the command. 

The RESET LOCK command is used by a processor who wants to indicate that it no longer is using a 
mailbox entry. This command contains the address of the mailbox entry no longer needed. When this 
command is received by command decoder 66. the most significant bit of the lock field corresponding to 
the addressed mailbox entry is reset to zero, indicating that the mailbox entry is not in use. If that bit were 

so already a zero, no error is flagged. By convention, a processor would only use this command for mailbox 
entries it was using. 



Combination Commands 

In order to increase the efficiency of using these commands, combination commands made up of the 
commands shown above can be used by the processors of the multiprocessing system to facilitate 
mterprocessor communications. 
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TEST h lN T D ES S PT A mr S . ET L0CK / N ° READ MESSAGE is ^ fa v a processor who wants to use both the 
TEST AND SET LOCK command and the READ MESSAGE command, as described above 

The RESET LOCK AND WRITE MESSAGE is used by a processor who wants to use both the RESET 
LOCK command and the WRITE MESSAGE command, as descr.bed above 

TES^IJdV^ nrf ^ AN ° WR,TE MESSAGE is used b * a P' ocessor " h ° wants to use both the 
TEST AND SET LOCK command and the WRITE MESSAGE command, as described above. Neither the 
lock write nor the message mite takes place if the lock field indicates that the ma.lbox entry ,s ,n use. 



'0 PROCESSOR INTERRUPT CIRCUITRY COMMAND 

The PROCESSOR INTERRUPT command is used by a processor that wants to set or reset a processor 
interrupt, including ,ts own interrupt. This command contains the address of the targeted processor or 
processors and one byte of interrupt data that sets or resets a processor interrupt. In the preferred 
is embodiment, this address is encoded to provide more function and flexibility. Encoding is used to 
compress the address field so that enough addresses are provided to address processors individually or as 
groups of processors. For example, address 1000 is processor 10 and address 1001 is processor 20 
Address 1111 ,s the address for "All Processors" which includes both processor 10 and processor 20 
When such a 'broadcast' aoaress is used, processor interrupt circuitry 80 must send the data byte to all 

20 processors in that group and will wait until all have responded. 

if, for example, processor 10 wants to send a byte of interrupt data to processor 20 it sends a 
processor interrupt command along with the address "1001" to holding register 61. Arbitration circuitry 60 
presents the command to command decoder 66. who decodes the command and sends it and the interrupt 
data byte on to holding register 81 in processor interrupt circuitry 80. Processor interrupt circuitry 80 

25 operates ,n a manner s.milar to arbitration circuitry 60. as has been discussed, and eventually places the 
interrupt byte .n output register 88. the output register dedicated to processor 20. The interrupt byte is then 
sent on return line 49 back to processor 20. 

Note that service processor 30 has a separate interrupt facility with processors 10 and 20 via service 
processor interfaces 12 and 22. as has been discussed, and is not addressable by processor interrupt 

30 circuitry 80. However, service processor 30 is able to originate a processor interrupt command and would 
do so m special cases, such as when it wants to send an interrupt to all system processors via a single 
command. 

Although only processor 10 and processor 20 are shown in Fig. i as being addressable by processor 
interrupt c.rcu.try 80. several additional processors, such as I/O processors. Instruction processors, or other 

35 type of processors, could be part of the multiprocessing system and could be addressable by processor 
interrupt circuitry 80. Any particular processor could be assigned to more than one group if desired For 
example, one group could be implemented which includes "all processors" while another could be "all I/O 
processors". In this example, each I/O processor would be in both groups. If additional processors are 
added, corresponding additional holding registers and output registers would be added, and arbiters 64 and 

40 84 would be modified slightly in a manner known to those skilled in the art. 

Several; examples of how the above commands can be used in the multiprocessing system of the 
invention will 'now be discussed. 

•«5 Processor H]'to Processor 20 Synchronous 

This example shows how the invention can be used to allow processor 10 to synchronously send a 
message to processor 20rand have processor 20 respond to the synchronous message, while processor 10 
waits for the 1 response from processor 20. Processor 10 issues a TEST AND SET LOCK AND WRITE 

so MESSAGE command to the address of a mailbox entry in mailbox portion 120 reserved for synchronous 
communication with processor 20. and checks that the lock was obtained. If it was obtained, the data that 
was written to the mailbox entry contains the message information and the lock field contains the lock ID of 
processor 10. if the lock was not obtained, then processor 10 must wait for the mailbox entry to be 
unlocked. In addition, the lock bit is set to one. indicating that the mailbox entry is in use, thereby 

55 preventing all other processors from using synchronous communication with processor 20 until processor 
10 has released the lock. 

Next, processor 10 sends an interrupt to processor 20 indicating a synchronous message is in the 
mailbox waiting for processing. Processor 10 uses the PROCESSOR INTERRUPT command to set the 



7 




EP 0 376 003 A2 



synchronous interrupt bit in processor 20. Processor 20 will soon detect the interrupt and will realize that a 
message is waiting in the mailbox. Processor 20 then will use a READ MESSAGE command to get the 
message. Processor 20 then uses the PROCESSOR INTERRUPT command to reset the interrupt that is 
being processed. Processor 20 dedicates its resources to process this message, and places the message 

s response back in the mailbox array at tr.e address of a mailbox entry located in mailbox array portion 1 10 
reserved for synchronous responses :o processor 10 with a WRITE MESSAGE command. Since the 
message handling is now complete, processor 20 indicates this with a PROCESSOR INTERRUPT 
command to set the response interrupt =it in processor 10. Since processor 20 has completed the message 
handling, it can now proceed with other tasks. 

w Meanwhile, processor 10 detects the response interrupt bit. signalling that processor 20 has completed 
the message handling and the response is in the mailbox array. Processor 10 obtains the response by 
executing a READ MESSAGE command followed by a RESET LOCK command. The message response is 
analyzed as desired, and the process is complete. The synchronous communications resources for 
processor 20 are now available once again to any processor. 

'5 This example uses a number of mailbox commands and processor interrupt commands to handle a 
message and message response in multiple processors. Main storage does not need to be accessed to 
accomplish the communications in both airections. thereby resulting in a significant performance advantage. 

20 Processor 10 to Processor 20 Asynchronous 



Asynchronous communications is accomplished by defining a list of task control blocks stored in main 
storage 40 for each processor receiving asynchronous communication. Instead of an eight byte message 
being placed in message field 140 of a mailbox entry (Fig. 4). task control block header information is used. 

as Specifically, message field segment 141 contains the beginning address of the task control block in main 
storage 40. and message field 142 contains the ending address of the task control block. 

When processor 10 finds a task that needs to be executed asynchronously by processor 20. the task is 
put into a task control block in mam memory 40. Processor 10 then issues a TEST AND SET LOCK AND 
READ MESSAGE command to the address of the maiibox entry reserved for asynchronous communications 

30 with processor 20. Processor 10 then cr.ecks if the lock has been obtained, and if so, uses the header data. 
Processor 10 then enqueues the task control block on processor 20's list, and uses the PROCESSOR 
INTERRUPT command to notify processor 20 if this enqueue is the first entry on the list. If this is not the 
first entry, the interrupt has already been set by convention. The list header is then updated in the mailbox 
entry and the lock reset with a RESET LOCK AND WRITE MESSAGE command. This completes processor 

35 10's participation in asynchronous communication and frees up resources so that other processors may 
enqueue or dequeue tasks on processor 20's list. 

When processor 20 detects the interrupt for asynchronous communication, the task control block 
header contained in the mailbox entry is again accessed by a TEST AND SET AND READ MESSAGE 
command, if the lock is obtained, processor 20 is allowed to dequeue list entries from the linked list. If it is 

40 not obtained, it can not dequeue asynchronous tasks. 

When the lock is obtained, processor 20 dequeues the top entry from the list. If it is removing the last 
entry in its own list, the asynchronous communications interrupt is reset by using the PROCESSOR 
INTERRUPT command and addressing it's own interrupt bit. This must be done while the mailbox lock is 
held by processor 20 to maintain integrity of the list. 

is The task control block header is updated and the lock reset by using the RESET LOCK AND WRITE 

MESSAGE command. This completes processor 20's participation in the asynchronous communication and 
frees up the resources for other processors to enqueue more tasks on processor 20's list while it executes 
the task it just removed from-the list. 

This example uses a few mailbox commands in conjunction with processor interrupt commands to allow 

so many processors to access individual work lists and pass work from one to another quickly and efficiently. 

Service Processor 30 to Processor 20 

55 The following shows how the invention could be used to satisfy an operator request to display main 
storage 40 starting at a specified address. The operator sends a request to the service processor 30. via 
keyboard input, to display sixty four bytes of main storage starting from a specified address. Service 
processor 30 first writes eight bytes of cata to the message field of a mailbox entry in mailbox array portion 

a 
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120 reserved for service processor 30 to processor 20 communications using the WRITE MESSAGE 
command. This data will include a predefined command instructing processor 20 to reaa from mam storage 
40. along with the mam storage address. 

Service processor 30 then senas a SERVICE PROCESSOR TO PROCESSOR INTERRUPT REQUEST 
5 from maintenance interface 32 to service processor interrupt registers 22 over bus 45 to processor 20. 
Service processor 30 then waits for a PROCESSOR TO SERVICE PROCESSOR INTERRUPT RESPONSE 
from processor 20 over-bus 45. 

When processor 20 detects the SERVICE PROCESSOR TO PROCESSOR INTERRUPT REQUEST, 
processor 20 issues a READ MESSAGE command to read the message contained m the mailbox entry. 
•o Processor 20 then inspects the message and deciphers that service processor 30 is requesting sixty four 
bytes of data starting from a specified main storage address. 

Processor "20 reads the first eight bytes of data starting at the main storage address, it then transfers 
this data to the?message field of the first mailbox entry in mailbox array portion 130 reserved for the use of 
service processor 30 via a WRITE MESSAGE command. In the preferred embodiment, service processor 
•s 30 has several mailbox entries reserved for its use in mailbox array portion 130 to efficiently handle data 
transfers such as that described in this example. 

Processor 20 then reads the next eight bytes from main storage 40 and writes this oata to the message 
field of the second mailbox entry reserved for the use of service processor 30 in mailbox array portion 130 
via another WRITE MESSAGE command. This process continues until all sixty four bytes have been read 
20 from main storage and transferred to subsequent mailbox entries in mailbox array portion 130. 

Processor "20 then responds to service processor 30 by sending a PROCESSOR TO SERVICE 
PROCESSOR INTERRUPT RESPONSE via bus 45. Service processor 30 then reads ;ne data contained in 
the message fields of its mailbox entries using several READ MESSAGE commands. Finally, service 
processor 30 outputs the requested sixty four bytes of data on the operator console. 



Claims 

1. A multiprocessing computer system having efficient interprocessor communications, comprising: 
30 a first processor; 

a second processor; 

interprocessor communications means, connected to said first processor and said second processor, for 
controlling communications between said first processor and said second processor directly without the use 
of main storage, said means further comprising: 
35 arbitration means, connected to said first processor and said second processor, for permitting only one 
processor to access said interprocessor communications means at a time; and 

mailbox means, connected to said arbitration means, for delivering interprocessor messages between said 
first processor and said second processor. 

2. The multiprocessor computer system of claim 1, wherein said arbitration means further comprises: 

•»o a first holding register, connected to said first processor, for holding first information from said first 
processor: 

a second holding register, connected to said second processor, for holding second information from said 
second processor: 

a first multiplexor, connected to said first holding register by a first data line, and connected to said second 
45 holding register' by a second data line; 

a first arbiter, connected to said first holding register by a first request line, connected to said second 

holding register by a second request line and connected to said first multiplexor by a control line; 

said first holding register-sending a first signal to said first arbiter over said first request line when it is 

holding said first information; and 
so said second holding register sending a second signal to said first arbiter over said second request line 

when it is holding said second information. 

3. The multiprocessor computer system of claim 2. wherein said arbitration means further comprises: 

a command decoder, connected between said first multiplexor and said mailbox means, for decoding a first 
command from said first information and a second command from said second information, 
ss 4. The multiprocessing system of claim 3. wherein said first arbiter further comprises: 

means for instructing said first multiplexor to send said first information contained on said first data line to 
said command decoder responsive to said first signal. 

5. The multiprocessing system of claim 4, wherein said first arbiter further comprises: 
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means for instructing said first multiplexor to send said second information contained on said second data 
line :o said command decoder responsive to said second signal if said second signal is received before 
sata : :rst signal. 

5. The multiprocessor computer system of claim 1, wherein said mailbox means further comonses: 
5 a manbox array having a plurality of mailbox entries, wherein a first portion of said mailbox entries are 
reserved for said first processor and a second portion of said mailbox entries are reserved fcr ==.d second 
processor. 

7 The multiprocessor computer system of claim 6. wherein each of said mailbox entries cor-onses: 
a message field for storing interprocessor messages; and 
to a lock field for storing lock information about said mailbox entry. 

3. The multiprocessor computer system of claim 7, wherein said lock field comprises: 
a lock bit for indicating if said mailbox entry is in use: and 
a lock ID for indicating which processor is using said mailbox entry. 

9. The multiprocessor computer system of claim 5. wherein said mailbox means further compnses: 

JS a maiibox array having a plurality of mailbox entries, wherein a first portion of said mailbox entries are 
reserved for said first processor and a second portion of said mailbox entries are reserved for said second 
processor. 

10. The multiprocessor computer system of claim 9, wherein each of said mailbox entries comprises: 
a message field lor storing interprocessor messages; and 

20 a lock field for storing lock information about said mailbox entry. 

11. The multiprocessor computer system of claim 10, wherein said lock field comprises: 
a locx bit for indicating if said mailbox entry is in use; and 

a lock ID for indicating which processor is using said mailbox entry. 

12. The multiprocessor computer system of claim 3. wherein said interprocessor communications 
25 means further comprises: 

processor interrupt means, connected to said arbitration means and said mailbox means, for 'delivering 
interprocessor interrupts between said first processor and said second processor. 

13. The multiprocessor computer system of claim 11, wherein said interprocessor communications 
means further comprises: 

30 processor interrupt means, connected to said arbitration means and said mailbox means, for delivering 
mtercrocessor interrupts between said first processor and said second processor. 

14. The multiprocessor computer system of claim 13. wherein said first information comprises: 
a first command: 

a first address; and 
as a first data. 

15. The multiprocessor computer system of claim 14, wherein said second information comprises: 
a second command; 

a second address; and 
a second data. 

40 16. The multiprocessing computer system of claim 15, wherein said command decoder further 

comprises: 

means for routing said first data to the mailbox entry specified by said first address if said first command is 
a maiibox command. 

17. The multiprocessing computer system of claim 16, wherein said command decoder further 
45 comprises: 

means for routing said first data to said processor interrupt means if said first command is a processor 
interrupt command. 

18. The multiprocessor -computer system of claim 17, wherein said processor interrupt means further 
comprises: 

so a fourth holding register, connected to said arbitration means, for holding said first data from said first 
processor; 

a fifth holding register, connected to said arbitration means, for holding said second data from said second 
processor; 

a second multiplexor, connected to said fourth holding register by a fourth data line, and connected to said 
55 fifth holding register by a fifth data line; and 

a second arbiter, connected to said fourth holding register by a fourth request line, connected to said fifth 
holding register by a fifth request line, and connected to said second multiplexor by a second control line: 
said fourth holding register sending a fourth signal to said second arbiter over said fourth request line when 
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it is holding said first data, 

said fifth holding register sending a fifth signal to said second arbiter over said fifth request line when it is 
holding said second data, 

said second arbiter comprising means for instructing said second multiplexor to send said first data 
5 contained orisaid fourth data line to the processor specified in said first address responsive to said fourth 
signal. 

19. The multiprocessor computer system of claim 18, wherein said processor interrupt means further 
comprises: 

said second arbiter comprising means for instructing said second multiplexor to send said second data 
to contained on said fifth data line to the processor specified in said second address responsive to said fifth 
signal if said fifth signal is received before said fourth signal. 

20. A multiprocessing computer system of claim 1 having efficient interprocessor communications, a 
first processor "a!hd a second processor comprising: 

a service processor capable of performing diagnostic and error recovery procedures for said system: 
'5 interprocessor communications means, connected to said first processor, said second processor, and said 
service processor for controlling communications between said first processor, said second processor, and 
said service processor directly without the use of main storage, said means further comprising: 
arbitration means, connected to said first processor, said second processor, and said service processor for 
permitting only'one processor to access said interprocessor communications means at a time; and 
20 mailbox meansf connected to said arbitration means, for delivering interprocessor messages between said 
first processor, "said second processor, and said service processor. 

21. The multiprocessor computer system of claim 20, wherein said arbitration means further comprises: 
a first holding register, connected to said first processor, for holding first information from said first 
processor; 

25 a second holding register, connected to said second processor, for holding second information from said 
second processor; 

a third holding register, connected to said service processor, for holding third information from said service 
processor; 

a first multiplexor, connected to said first holding register by a first data line, connected to said second 
30 holding register by a second data line, and connected to said third holding register by a third data line: 

a first arbiter, connected to said first holding register by a first request line, connected to said second 
holding register by a second request line, connected to said third holding register by a third request line, 
and connected to said first multiplexor by a first control line: 

said first holding register sending a first signal to said first arbiter over said first request line when it is 
35 holding said first information; 

said second holding register sending a second signal to said first arbiter over said second request line 
when it is holding said second information; and 

said third holding register sending a third signal to said first arbiter over said third request line when it is 
holding said third information. 
40 22. The multiprocessor computer system of claim 21. wherein said arbitration means further comprises: 

a command decoder, connected between said first multiplexor and said mailbox means, for decoding a first 
command from said first information, a second command from said second information, and a third 
command from- said third information. 

23. The multiprocessing system of claim 22. wherein said first arbiter further comprises: 

45 means for instructing said first multiplexor to send said first information contained on said first data line to 
said command decoder responsive to said first signal. 

24. The multiprocessing system of claim 23. wherein said first arbiter further comprises: 

means for instructing said" first multiplexor to send said second information contained on said second data 
line to said command decoder responsive to said second signal if said second signal is received before 
so said first signal. 

25. The multiprocessing system of claim 24. wherein said first arbiter further comprises: 

means for instructing said first multiplexor to send said third information contained on said third data line to 
said command decoder responsive to said third signal if said third signal is received before said first signal 
and said second signal. 

55 26. The multiprocessor computer system of claim 20. wherein said mailbox means further comprises: 
a mailbox array having a plurality of mailbox entries, wherein a first portion of said mailbox entries are 
reserved for said first processor, a second portion of said mailbox entries are reserved for said second 
processor, and a third portion of said mailbox entries are reserved for said service processor. 
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27. The multiprocessor computer system of clam 26. where.n each of sa,d mailbox entnes comor.ses- 
a message field for storing interprocessor messages; and composes, 
a lock field for storing lock information about said mailbox entry 

28. The multiprocessor computer system of claim 27, where.n said lock field comprises- 
- a lock bit for indicating if said mailbox entry i s in use; and 

a lock 10 for indicating which processor is using said mailbox entry 

a Jl™ 6 muiti P rocessor computer system of claim 25. where.fi said mailbox means further comprises- 
a manbox array havmg a plurality of mailbox entries, wherein a first portion of sa.d manoox en.nes are 
reserved for said first processor, a second portion of sa.d ma-box entnes are reserved for said econd 
P Tt' 3 th ' rd POrt '° n ° f Sa ' d maitbox emnes a ' e rese - ea *" "id serv.ce processor 

a messaoe^ fr°? SS ° r C ° mPUter ° f ^ 2Q ' e * Ch °' sa,d ma,lbo * ^'r.es comprises- 

a message field for storing interprocessor messages; and 

a lock field for storing lock information about said mailbox entry 

31 . The multiprocessor computer system of claim 30. wherein sa ,d lock field comprises- 

'5 a lock b.t for indicating if said mailbox entry is in use; and 

a lock ID for indicating which processor is using said mailbox entry 

m e a 3 n^u T rttr7oZ^s C eT 0r ^ * ^ ^ "« '"-Pressor communications 

■o r n »™™ ' nterrUPt mSanS ' C ° nneCted t0 sa,d arbitration means and sa,d mailbox means, for delivering 
•o interprocessor interrupts between sa.d first processor and said second processor aei.venng 

rn.. 3 „.-^™™ C ° mPUter SYStem ° f C ' a,m 31 ' Wnerem S3,d ssor communicates 

rerp7ocesroMZrrr h S ; COnneC, : d f t0 Sa ' d arD ' trat,0n meanS 3nd Sa,d maMbox means - <°< d eiivenng 
interprocessor interrupts between said first processor and said second processor 

5 a firsTcommrnd^' 006350 ' COmpUU3r SyS,em ° f Ciaim 33 ' where ' n sa ' d fir * information comprises: 
a first address: and 
a first data. 

0 a sec^ C ° mC "" e ' ^ " Whe ' e ' n SeC ° na ""P*™ 

a second address: and 
a second data. 

a third 6 comm r and PrCCeSS ° r C ° mPUter SyStem ° f C,a ' m 35 ' wherein said third information comprises: 
> a third address; and 
a third data. 

comprises: 6 mU,, ' PrOCeSSin9 computer s * stem of Cairn 36. where.n sa.d command decoder further 

' ^Z^Z^lnT ^ *"* * ^ mai '°° X ^ firSt addr6SS ' f S3 ' d firSt COmmand ' s 

com P nses he mU ' tiPr0CeSSin9 Computer °' claim 37, wnerein said command decoder further 

S«. Said firSt t0 Pr ° CeSSOr m,errupt if said first command is a processor 

compnseT 6 mU ' ,iPr ° CeSSOr COmputer s * stem of claim 38. where.n said processor interrupt means further 
proce r s S h or h0,din9 r69iSter ' C °^ neC,ed tQ sa ' d arb ' tration m ^ns. for holding said first data from sa.d first 
Processor'" 9 r69iSter * C ° nneCted * Sa ' d arbitfati ° n meanS> tor h °' dinQ Said S6C0nd data ' rom said **ond 
processor" 9 re9 ' S,er ' C ° nneCted t0 Sa ' d arbi,ration means - <° r h °"*"9 said third data from sa.d serv.ee 

^^^^',^7?^ t0 Sa ' d f ° Urth h0,din ° r69iSter Dy 3 f ° Urth data line ' C0nn6Cted to sa,d ««" 
TITnn* T, V U ° e ' 3nd connec,ed t0 a Si ^ n holding reg.ster by a sixth data line: 

ho dmo "IJ^T^T^ * '*? ^ h0 ' dm9 r " ,Ster by 3 ^ requ6St ' ine ' connec ted to sa,d fifth 

connect eltl iJJZ """^ * Mid ^ h0 ' Cma re 9 iSter by 3 s, * th 

connected to said second multiplexor by a second control line; and 

said fourth holding reg.ster sending a fourth signal to sa.d second arbiter over sa.d fourth request line when 
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it is holding said first data. 

said fifth holding register sending a firth signal to said second arbiter over said fifth request line when it is 
holding said second data, 

said sixth holding register sending a sixth signal to said second arbiter over said sixth request line when it 
5 is holding said third data. 

said second arbiter comprising means for instructing said second multiplexor to send said first data 
contained on said fourth data line to the processor specified in said first address responsive to said fourth 
signal. 

40. The multiprocessor computer system of claim 39. wherein said processor interrupt means further 
'a comprises: 

said second arbiter comprising means for instructing said second multiplexor to send said second data 
contained on^said fifth data line to the processor specified in said second address responsive to said fifth 
signal if said fifth signal is received before said fourth signal. 

41. The multiprocessor computer system of claim 40. wherein said processor interrupt means further 
'5 comprises: 

said second arbiter comprising means for instructing said second multiplexor to send said third data 
contained pn^said sixth data line to the processor specified in said third address responsive to said sixth 
signal if said sixth signal is received before said fourth signal and said fifth signal. 

42. The multiprocessor computer system of claim 41. wherein said first command is a write message 
20 command. t 

43. The multiprocessor computer system of claim 41. wherein said first command is a read message 
command. 

44. The multiprocessor computer system of claim 41. wherein said first command is a write lock 
command. 

2S 45. The multiprocessor computer system of claim 41, wherein said first command is a read lock 

command. 

46. The multiprocessor computer system of claim 41, wherein said first command is a test and set lock 
command. 

47. The multiprocessor computer system of claim 41. wherein said first command is a reset lock 
30 command. 

48. The multiprocessor computer system of claim 41, wherein said first command is a test and set lock 
and read message command. 

49. The multiprocessor computer system of claim 41 , wherein said first command is a reset lock and 
write message command. 

35 50. The multiprocessor computer system of claim 41, wherein said first command is a test and set lock 

and write message command. 

5 1 . A method of communication between a first processor and a second processor in a multiprocessing 
system having interprocessor communications means connected between said first processor and said 
second processor, said interprocessor communications means having a first mailbox entry for holding 

to messages for said first processor and having a second mailbox entry for holding messages for said second 
processor, said method comprising the steps of: 

said first processor sending a write message command to said interprocessor communications means, said 
command containing a message for said second processor and specifying the address of said second 
mailbox entry; 

45 said interprocessor communications means placing said message for said second processor in said second 
mailbox entry: 

said second processor transmitting a read message command to said interprocessor communications 
means, said command specifying the address of said second mailbox entry; and 

said interprocessor communications means sending said message for said second processor to said 
so second processor responsive to said transmitting step. 

52. A method of claim 51 with each of said mailbox entries having a message field and a lock field, said 
method comprising the steps of: 

said first processor sending a test and set lock and write message command to said interprocessor 
communications means, said command containing a message for said second processor and specifying the 
55 address of said second mailbox entry; 

said interprocessor communications means testing the lock field of said second mailbox entry to determine 
if said second mailbox entry is available for use; 

said interprocessor communications means placing identification indicia of said first processor into said lock 
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: ieid of said second mailbox entry responsive to said testing step indicating said second mailbox entry was 
available for use: 

said interprocessor communications means placing said message for said second processor in said second 
mailbox entry responsive to said testing step indicating said second mailbox entry was available for use; 
said second processor transmitting a read message command to said interprocessor communications 
means, said command specifying the address of said second mailbox entry; and 

said interprocessor commun.cations means sending said message for said second processor to said 
second processor responsive to said transmitting step. 

53. A method of claim 52 said interprocessor communications means also having processor interrupt 
means, said method comrpising the steps of: 

said first processor sending a test and set lock and write message command to said interprocessor 
communications means, said command containing a message for said second processor and specifying the 
address of said second mailbox entry; 

said interprocessor communications means testing the lock field of said second mailbox entry to determine 
if said second mailbox entry is available for use; 

said interprocessor communications means placing identification indicia of said first processor into said lock 
field of said second mailbox entry responsive to said testing step indicating said second mailbox entry was 
available for use; 

said interprocessor communications means placing said message for said second processor in said second 
mailbox entry responsive to said testing step indicating said second mailbox entry was available for use; 
said first processor sending a orocessor interrupt command to said interprocessor communications means, 
said processor interrupt command containing an interrupt for said second processor; 

said interprocessor communications means sending said interrupt for said second processor to said second 
processor- 
said second processor transmitting a read message command to said interprocessor communications 
means, said command specifying the address of said second mailbox entry, said transmitting step 
responsive to said interrupt for said second processor; and 

said interprocessor communications means sending said message for said second processor to said 
second processor responsive to said transmitting step. 
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© A plurality of processors are connected to the diin- 
interprocessor communications facility in the mul- 
tiprocessing system of the invention. The inter- 
processor communications facility has arbitration cir- 
cuitry, mailbox circuitry, and processor interrupt cir- 
cuitry The interprocessor communications facility of 
the invention is centralized and does not require the 
use of main storage. This enables processors to 
communicate with each other in a fast and efficient 
manner. The arbitration circuitry prevents simulta- 
neous access of the interprocessor communications 
facility by more than one processor, and decodes 
the commands sent from the processors and routes 
them to the processor interrupt circuitry or to the 
mailbox circuitry, depending on the command. The 
mailbox circuitry of the invention receives messages 
from sending processors and provides them to the 
intended receiving processors in a safe and secure 
manner. The processor interrupt ctrcuitry facilitates 
the interprocessor communications process by han- 
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